[Feature](nereids) support encrypt sql for audit log by qzsee · Pull Request #47595 · apache/doris

qzsee · 2025-02-07T08:05:28Z

What problem does this PR solve?

Issue Number: close #xxx

The new optimizer does not support the encryption of sql sensitive information well, so it implements a general encryption framework

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-02-07T08:05:35Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4

starocean999 · 2025-02-11T06:52:09Z

CreateTableCommand need to be encrypted in some case, and please check if CreateSqlBlockRuleCommand or other command is needed too

qzsee · 2025-02-12T03:03:18Z

CreateTableCommand need to be encrypted in some case, and please check if CreateSqlBlockRuleCommand or other command is needed too

SQL of CreateSqlBlockRuleCommand could be written based on regular expressions, not good encryption

dqz123 · 2025-02-14T02:11:28Z

run buildall

github-actions · 2025-02-14T02:38:04Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-02-14T02:38:06Z

PR approved by anyone and no changes requested.

doris-robot · 2025-02-14T02:50:16Z

TPC-H: Total hot run time: 31492 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eb73f2003b0b3f104202c0091636ac726a1c3713, data reload: false

------ Round 1 ----------------------------------
q1	17608	5201	5011	5011
q2	2053	292	169	169
q3	10413	1231	748	748
q4	10220	994	510	510
q5	7524	2330	2314	2314
q6	176	168	133	133
q7	889	767	590	590
q8	9306	1208	1111	1111
q9	4791	4810	4694	4694
q10	6821	2278	1886	1886
q11	487	275	251	251
q12	338	352	222	222
q13	17850	3850	3195	3195
q14	235	228	214	214
q15	524	467	470	467
q16	621	603	596	596
q17	598	869	339	339
q18	7098	6083	6231	6083
q19	1222	935	534	534
q20	309	325	190	190
q21	2729	2180	1926	1926
q22	365	332	309	309
Total cold run time: 102177 ms
Total hot run time: 31492 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5064	5035	5036	5035
q2	234	326	230	230
q3	2120	2662	2310	2310
q4	1370	1841	1369	1369
q5	4238	4146	4130	4130
q6	205	164	127	127
q7	1843	1800	1640	1640
q8	2562	2739	2602	2602
q9	7178	7135	7128	7128
q10	3031	3210	2771	2771
q11	572	509	499	499
q12	702	767	605	605
q13	3560	3867	3245	3245
q14	285	295	262	262
q15	525	466	466	466
q16	655	687	644	644
q17	1113	1577	1363	1363
q18	7649	7323	7058	7058
q19	779	822	935	822
q20	1959	1991	1891	1891
q21	5490	4923	4801	4801
q22	607	618	538	538
Total cold run time: 51741 ms
Total hot run time: 49536 ms

doris-robot · 2025-02-14T03:02:21Z

TPC-DS: Total hot run time: 189899 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eb73f2003b0b3f104202c0091636ac726a1c3713, data reload: false

query1	1303	972	926	926
query2	6217	1856	1826	1826
query3	10982	4645	4643	4643
query4	56422	25029	23427	23427
query5	5117	494	509	494
query6	363	199	177	177
query7	5113	505	287	287
query8	331	230	222	222
query9	6822	2545	2548	2545
query10	421	298	247	247
query11	15088	15151	14917	14917
query12	159	112	109	109
query13	1186	530	402	402
query14	10676	6784	6236	6236
query15	195	202	181	181
query16	7084	654	497	497
query17	1069	748	598	598
query18	1557	429	323	323
query19	209	196	175	175
query20	134	133	123	123
query21	210	124	105	105
query22	4315	4498	4286	4286
query23	33838	33525	33375	33375
query24	5587	2430	2428	2428
query25	451	469	401	401
query26	669	276	152	152
query27	1683	517	331	331
query28	2783	2473	2428	2428
query29	600	535	417	417
query30	223	188	159	159
query31	898	863	844	844
query32	79	59	61	59
query33	438	374	304	304
query34	767	851	518	518
query35	784	830	743	743
query36	972	1019	920	920
query37	120	102	91	91
query38	4214	4273	4322	4273
query39	1471	1467	1410	1410
query40	215	124	105	105
query41	52	49	52	49
query42	125	105	105	105
query43	481	514	493	493
query44	1309	807	810	807
query45	187	170	167	167
query46	890	1055	645	645
query47	1802	1897	1787	1787
query48	397	420	309	309
query49	704	517	446	446
query50	700	749	416	416
query51	4264	4334	4188	4188
query52	110	112	102	102
query53	237	268	186	186
query54	466	483	419	419
query55	85	89	85	85
query56	301	265	250	250
query57	1162	1195	1165	1165
query58	246	252	239	239
query59	2793	2759	2581	2581
query60	282	281	253	253
query61	149	120	114	114
query62	729	743	689	689
query63	227	190	198	190
query64	1468	1035	678	678
query65	3226	3118	3176	3118
query66	710	387	292	292
query67	15855	15663	15420	15420
query68	5354	771	492	492
query69	525	284	259	259
query70	1221	1155	1054	1054
query71	455	280	262	262
query72	6406	3688	3713	3688
query73	1141	740	347	347
query74	9254	9144	8995	8995
query75	3387	3157	2685	2685
query76	3860	1163	720	720
query77	539	366	290	290
query78	9990	9960	9260	9260
query79	2817	789	571	571
query80	730	512	509	509
query81	492	273	237	237
query82	686	123	93	93
query83	302	163	144	144
query84	289	88	68	68
query85	770	350	301	301
query86	408	304	278	278
query87	4370	4537	4312	4312
query88	3382	2198	2175	2175
query89	396	316	293	293
query90	1861	189	191	189
query91	136	138	106	106
query92	75	58	53	53
query93	2136	994	565	565
query94	680	411	299	299
query95	353	258	263	258
query96	483	557	269	269
query97	2792	2796	2732	2732
query98	225	203	196	196
query99	1418	1391	1302	1302
Total cold run time: 296655 ms
Total hot run time: 189899 ms

doris-robot · 2025-02-14T03:07:40Z

ClickBench: Total hot run time: 30.17 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eb73f2003b0b3f104202c0091636ac726a1c3713, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.24	0.06	0.06
query4	1.63	0.09	0.10
query5	0.42	0.42	0.40
query6	1.15	0.66	0.66
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.51	0.50
query10	0.58	0.58	0.57
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	2.79	2.81	2.79
query15	0.93	0.85	0.85
query16	0.39	0.38	0.39
query17	1.04	1.01	1.01
query18	0.21	0.20	0.19
query19	1.99	1.85	2.00
query20	0.02	0.01	0.01
query21	15.35	0.94	0.54
query22	0.74	1.29	0.78
query23	14.75	1.42	0.64
query24	12.52	1.05	0.29
query25	0.34	0.12	0.08
query26	0.70	0.19	0.14
query27	0.05	0.04	0.04
query28	5.97	0.78	0.42
query29	12.62	3.91	3.26
query30	0.25	0.08	0.06
query31	2.83	0.59	0.39
query32	3.22	0.54	0.46
query33	2.99	2.99	3.01
query34	15.70	5.10	4.49
query35	4.43	4.48	4.50
query36	0.68	0.51	0.49
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.14	0.15
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.7 s
Total hot run time: 30.17 s

dqz123 · 2025-02-14T11:05:43Z

run buildall

doris-robot · 2025-02-14T11:44:35Z

TPC-H: Total hot run time: 31617 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85ca401380e9ddf98e8160be4275c63f43a7e23f, data reload: false

------ Round 1 ----------------------------------
q1	17593	5195	5089	5089
q2	2046	329	165	165
q3	10641	1232	728	728
q4	10211	994	532	532
q5	7525	2401	2328	2328
q6	184	167	139	139
q7	898	755	602	602
q8	9306	1276	1121	1121
q9	4792	4838	4729	4729
q10	6825	2295	1892	1892
q11	470	279	269	269
q12	342	352	210	210
q13	18268	3786	3044	3044
q14	236	235	203	203
q15	536	476	460	460
q16	635	599	585	585
q17	572	837	350	350
q18	6640	6218	6249	6218
q19	1667	946	571	571
q20	311	324	193	193
q21	2758	2152	1899	1899
q22	372	329	290	290
Total cold run time: 102828 ms
Total hot run time: 31617 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5238	5166	5191	5166
q2	235	320	220	220
q3	2166	2641	2283	2283
q4	1464	1840	1395	1395
q5	4189	4135	4135	4135
q6	209	162	125	125
q7	1849	1774	1701	1701
q8	2599	2653	2533	2533
q9	7176	7148	6965	6965
q10	3009	3212	2785	2785
q11	566	509	499	499
q12	684	768	629	629
q13	3468	3862	3288	3288
q14	279	284	268	268
q15	496	469	452	452
q16	655	686	639	639
q17	1129	1593	1297	1297
q18	7474	7445	7318	7318
q19	800	830	974	830
q20	1943	2015	1869	1869
q21	5440	4871	4820	4820
q22	624	534	538	534
Total cold run time: 51692 ms
Total hot run time: 49751 ms

doris-robot · 2025-02-14T11:56:32Z

TPC-DS: Total hot run time: 189210 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 85ca401380e9ddf98e8160be4275c63f43a7e23f, data reload: false

query1	1297	960	960	960
query2	6232	1854	1805	1805
query3	11083	4622	4462	4462
query4	53696	25597	22916	22916
query5	4970	594	498	498
query6	326	207	188	188
query7	4868	524	294	294
query8	306	252	236	236
query9	5427	2524	2519	2519
query10	419	290	265	265
query11	15240	15168	14993	14993
query12	154	105	106	105
query13	1035	519	373	373
query14	10859	6647	6220	6220
query15	204	199	183	183
query16	7153	673	493	493
query17	1056	718	561	561
query18	1572	418	311	311
query19	189	193	155	155
query20	122	127	128	127
query21	207	118	107	107
query22	4648	4357	4295	4295
query23	33852	33374	33345	33345
query24	5729	2452	2410	2410
query25	447	461	389	389
query26	696	270	156	156
query27	1848	482	332	332
query28	2777	2433	2385	2385
query29	564	573	455	455
query30	218	190	156	156
query31	913	925	802	802
query32	70	63	61	61
query33	417	357	299	299
query34	783	846	494	494
query35	812	842	748	748
query36	977	995	924	924
query37	129	96	73	73
query38	4184	4310	4180	4180
query39	1533	1421	1438	1421
query40	205	115	109	109
query41	51	52	51	51
query42	129	112	150	112
query43	492	485	468	468
query44	1348	794	798	794
query45	178	178	179	178
query46	878	1074	676	676
query47	1825	1878	1792	1792
query48	383	426	311	311
query49	675	516	404	404
query50	720	753	416	416
query51	4239	4331	4191	4191
query52	113	108	104	104
query53	240	270	185	185
query54	488	485	432	432
query55	87	82	84	82
query56	272	297	266	266
query57	1168	1198	1126	1126
query58	247	240	268	240
query59	2658	2905	2772	2772
query60	280	273	274	273
query61	130	120	116	116
query62	750	741	674	674
query63	226	196	187	187
query64	1542	1138	791	791
query65	3279	3189	3133	3133
query66	729	403	316	316
query67	15909	15411	15508	15411
query68	3532	790	520	520
query69	503	319	262	262
query70	1239	1153	1150	1150
query71	413	306	276	276
query72	6461	3583	3764	3583
query73	703	731	346	346
query74	9274	9164	8682	8682
query75	3140	3117	2682	2682
query76	2379	1155	749	749
query77	515	363	287	287
query78	10192	10146	9447	9447
query79	2362	796	595	595
query80	982	523	448	448
query81	555	270	235	235
query82	447	128	95	95
query83	200	166	149	149
query84	291	94	67	67
query85	766	347	307	307
query86	379	311	293	293
query87	4475	4462	4352	4352
query88	2757	2212	2132	2132
query89	435	315	294	294
query90	1592	190	185	185
query91	137	139	108	108
query92	61	60	64	60
query93	1343	983	575	575
query94	669	394	294	294
query95	344	274	260	260
query96	495	548	270	270
query97	2794	2852	2689	2689
query98	222	206	201	201
query99	1318	1389	1311	1311
Total cold run time: 287228 ms
Total hot run time: 189210 ms

doris-robot · 2025-02-14T12:01:51Z

ClickBench: Total hot run time: 30.18 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 85ca401380e9ddf98e8160be4275c63f43a7e23f, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.10
query5	0.42	0.43	0.41
query6	1.18	0.67	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.61	0.51	0.50
query10	0.57	0.59	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.10
query13	0.62	0.58	0.60
query14	2.68	2.68	2.72
query15	0.93	0.85	0.85
query16	0.37	0.36	0.38
query17	1.03	1.06	1.04
query18	0.21	0.19	0.19
query19	1.98	1.85	1.96
query20	0.01	0.01	0.01
query21	15.35	0.91	0.55
query22	0.76	1.07	0.62
query23	15.07	1.38	0.59
query24	11.50	1.09	0.41
query25	0.51	0.20	0.08
query26	1.02	0.18	0.14
query27	0.05	0.05	0.05
query28	6.09	0.77	0.44
query29	12.56	4.02	3.31
query30	0.26	0.09	0.06
query31	2.82	0.57	0.39
query32	3.22	0.54	0.47
query33	2.96	3.02	3.00
query34	16.24	5.17	4.55
query35	4.54	4.56	4.56
query36	0.68	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.02	0.03	0.02
query40	0.17	0.12	0.12
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.05 s
Total hot run time: 30.18 s

dqz123 · 2025-02-19T01:55:17Z

run buildall

doris-robot · 2025-02-19T03:36:23Z

TPC-H: Total hot run time: 31623 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6c12b594c5f797c3066cca0c05c3b9351a6d56e9, data reload: false

------ Round 1 ----------------------------------
q1	17597	5399	5117	5117
q2	2055	311	174	174
q3	10447	1257	753	753
q4	10209	1035	557	557
q5	7556	2456	2291	2291
q6	186	166	132	132
q7	896	753	605	605
q8	9310	1364	1204	1204
q9	4983	4714	4812	4714
q10	6850	2307	1881	1881
q11	499	285	262	262
q12	366	358	224	224
q13	17803	3670	3065	3065
q14	220	224	207	207
q15	515	483	466	466
q16	633	611	583	583
q17	595	877	322	322
q18	7235	6241	6027	6027
q19	1900	944	570	570
q20	318	324	190	190
q21	2852	2136	1977	1977
q22	357	334	302	302
Total cold run time: 103382 ms
Total hot run time: 31623 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5256	5210	5200	5200
q2	238	333	225	225
q3	2129	2654	2290	2290
q4	1415	1823	1328	1328
q5	4229	4139	4193	4139
q6	212	161	125	125
q7	1925	1856	1754	1754
q8	2610	2606	2513	2513
q9	7202	7183	7187	7183
q10	3024	3188	2794	2794
q11	584	533	479	479
q12	693	810	612	612
q13	3357	3899	3268	3268
q14	274	294	279	279
q15	515	481	461	461
q16	630	679	653	653
q17	1169	1700	1338	1338
q18	7691	7342	7350	7342
q19	807	784	870	784
q20	1982	2054	1897	1897
q21	5451	5033	4840	4840
q22	620	590	542	542
Total cold run time: 52013 ms
Total hot run time: 50046 ms

doris-robot · 2025-02-19T03:48:27Z

TPC-DS: Total hot run time: 190852 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6c12b594c5f797c3066cca0c05c3b9351a6d56e9, data reload: false

query1	1315	979	916	916
query2	6232	1998	1945	1945
query3	10992	4414	4489	4414
query4	55514	24466	23476	23476
query5	5095	574	499	499
query6	346	194	212	194
query7	4981	509	297	297
query8	324	241	248	241
query9	5799	2543	2562	2543
query10	445	342	249	249
query11	15242	15104	15000	15000
query12	161	110	108	108
query13	1067	518	393	393
query14	10415	6840	6627	6627
query15	220	214	183	183
query16	7118	669	482	482
query17	1104	748	594	594
query18	1610	428	334	334
query19	207	193	161	161
query20	131	128	124	124
query21	203	132	109	109
query22	4476	4404	4469	4404
query23	33985	33357	33504	33357
query24	5834	2462	2453	2453
query25	475	477	416	416
query26	712	283	149	149
query27	1744	508	342	342
query28	2843	2499	2458	2458
query29	580	564	446	446
query30	222	196	162	162
query31	886	853	822	822
query32	78	68	63	63
query33	444	355	332	332
query34	764	879	505	505
query35	823	846	761	761
query36	915	1000	900	900
query37	118	101	75	75
query38	4233	4359	4298	4298
query39	1512	1424	1455	1424
query40	211	120	105	105
query41	54	50	67	50
query42	124	106	99	99
query43	505	529	510	510
query44	1306	824	824	824
query45	181	173	168	168
query46	900	1051	663	663
query47	1938	1899	1820	1820
query48	423	441	308	308
query49	693	502	426	426
query50	729	748	425	425
query51	4303	4311	4261	4261
query52	107	105	97	97
query53	233	270	201	201
query54	533	491	414	414
query55	80	82	82	82
query56	259	280	263	263
query57	1199	1157	1114	1114
query58	244	242	254	242
query59	2895	2997	2790	2790
query60	290	284	251	251
query61	114	126	142	126
query62	714	769	684	684
query63	236	208	196	196
query64	1884	1081	682	682
query65	3188	3084	3117	3084
query66	734	398	303	303
query67	16005	15433	15367	15367
query68	5349	776	529	529
query69	515	306	263	263
query70	1207	1125	999	999
query71	423	298	270	270
query72	6042	3585	3757	3585
query73	1154	740	373	373
query74	8969	9200	8968	8968
query75	3224	3139	2694	2694
query76	3866	1168	746	746
query77	537	375	286	286
query78	9956	9991	9279	9279
query79	2252	842	611	611
query80	572	525	446	446
query81	499	284	233	233
query82	242	126	96	96
query83	192	214	161	161
query84	283	91	73	73
query85	769	349	299	299
query86	370	326	294	294
query87	4455	4458	4385	4385
query88	3746	2220	2210	2210
query89	411	315	288	288
query90	1743	192	189	189
query91	137	151	108	108
query92	75	57	57	57
query93	1953	1003	592	592
query94	660	395	263	263
query95	340	267	251	251
query96	497	559	287	287
query97	2835	2833	2704	2704
query98	229	204	202	202
query99	1333	1410	1300	1300
Total cold run time: 294082 ms
Total hot run time: 190852 ms

doris-robot · 2025-02-19T03:53:47Z

ClickBench: Total hot run time: 30.16 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6c12b594c5f797c3066cca0c05c3b9351a6d56e9, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.04
query3	0.24	0.07	0.06
query4	1.61	0.10	0.11
query5	0.41	0.41	0.39
query6	1.15	0.66	0.66
query7	0.03	0.02	0.01
query8	0.04	0.04	0.03
query9	0.60	0.51	0.51
query10	0.57	0.56	0.56
query11	0.15	0.11	0.11
query12	0.15	0.10	0.11
query13	0.62	0.60	0.60
query14	2.69	2.70	2.71
query15	0.91	0.86	0.84
query16	0.36	0.39	0.37
query17	1.01	1.01	1.02
query18	0.21	0.20	0.20
query19	1.84	1.80	1.98
query20	0.01	0.01	0.01
query21	15.36	0.88	0.55
query22	0.75	1.19	0.62
query23	15.01	1.37	0.62
query24	12.39	1.09	0.41
query25	0.55	0.27	0.13
query26	0.88	0.19	0.16
query27	0.05	0.04	0.05
query28	6.09	0.74	0.42
query29	12.51	3.92	3.34
query30	0.25	0.09	0.06
query31	2.81	0.57	0.38
query32	3.22	0.54	0.46
query33	3.09	3.00	3.13
query34	15.73	5.07	4.51
query35	4.49	4.52	4.53
query36	0.68	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.07	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 107.04 s
Total hot run time: 30.16 s

### What problem does this PR solve? The new optimizer does not support the encryption of sql sensitive information well, so it implements a general encryption framework Co-authored-by: garenshi <garenshi@tencent.com>

…48527) ### What problem does this PR solve? Issue Number: close #xxx Related PR: #47595 Problem Summary: For PR #47595 , set `stmt` to `error messsage` of `org.apache.doris.qe.QueryState.ErrType#ANALYSIS_ERR` of query audit, so many of the original SQL will be abandoned, this is very unreasonable, It is now more appropriate to set stmt to error message only for queries that are syntax parsed incorrectly Now only sql with syntax errors is ignored Co-authored-by: garenshi <garenshi@tencent.com>

…pache#48527) ### What problem does this PR solve? Issue Number: close #xxx Related PR: apache#47595 Problem Summary: For PR apache#47595 , set `stmt` to `error messsage` of `org.apache.doris.qe.QueryState.ErrType#ANALYSIS_ERR` of query audit, so many of the original SQL will be abandoned, this is very unreasonable, It is now more appropriate to set stmt to error message only for queries that are syntax parsed incorrectly Now only sql with syntax errors is ignored Co-authored-by: garenshi <garenshi@tencent.com>

…48527) ### What problem does this PR solve? Issue Number: close #xxx Related PR: #47595 Problem Summary: For PR #47595 , set `stmt` to `error messsage` of `org.apache.doris.qe.QueryState.ErrType#ANALYSIS_ERR` of query audit, so many of the original SQL will be abandoned, this is very unreasonable, It is now more appropriate to set stmt to error message only for queries that are syntax parsed incorrectly Now only sql with syntax errors is ignored Co-authored-by: garenshi <garenshi@tencent.com>

…e#47595

#58508) picked from #47595

garenshi added 2 commits February 7, 2025 15:48

[Feature](nereids) support encrypt sql for audit log

fcec55b

1

6632964

morrySnow reviewed Feb 11, 2025

View reviewed changes

fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 Outdated Show resolved Hide resolved

fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisParser.g4 Outdated Show resolved Hide resolved

garenshi added 6 commits February 12, 2025 11:14

1

1a34530

1

8422705

1

6345216

1

238734b

1

071d4d8

1

eb73f20

morrySnow requested a review from starocean999 February 14, 2025 02:35

starocean999 previously approved these changes Feb 14, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 14, 2025

github-actions bot added the reviewed label Feb 14, 2025

morrySnow previously approved these changes Feb 14, 2025

View reviewed changes

1

85ca401

qzsee dismissed stale reviews from morrySnow and starocean999 via 85ca401 February 14, 2025 10:59

morrySnow closed this Feb 19, 2025

morrySnow reopened this Feb 19, 2025

morrySnow approved these changes Feb 19, 2025

View reviewed changes

starocean999 approved these changes Feb 19, 2025

View reviewed changes

morrySnow added kind/need-document and removed kind/need-document labels Feb 19, 2025

morrySnow merged commit 3688fdb into apache:master Feb 19, 2025
28 checks passed

qzsee mentioned this pull request Mar 3, 2025

[Improve](audit) sql that fails to be syntax parsed is not audited #48527

Merged

16 tasks

starocean999 mentioned this pull request Mar 14, 2025

branch-3.0: [fix](nereids)make lambda expression can only be function argument #53657 #49068

Merged

morningman added the dev/3.1.x label Mar 28, 2025

morningman mentioned this pull request Jun 29, 2025

[fix](audit) fix potential NPE when auditing #51620

Merged

16 tasks

morningman added the dev/4.0.x label Oct 30, 2025

github-actions bot added the dev/4.0.x-conflict label Oct 30, 2025

morrySnow removed dev/4.0.x dev/4.0.x-conflict labels Nov 21, 2025

starocean999 added a commit to starocean999/incubator-doris that referenced this pull request Nov 28, 2025

branch-3.1:[Feature](nereids) support encrypt sql for audit log apach…

5d4c3be

…e#47595

starocean999 mentioned this pull request Nov 28, 2025

branch-3.1:[Feature](nereids) support encrypt sql for audit log #47595 #58508

Merged

morrySnow pushed a commit that referenced this pull request Dec 1, 2025

branch-3.1:[Feature](nereids) support encrypt sql for audit log #47595 (

077f250

#58508) picked from #47595

morrySnow added dev/3.1.4-merged and removed dev/3.1.x labels Dec 1, 2025

Conversation

qzsee commented Feb 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Feb 7, 2025

Uh oh!

Uh oh!

Uh oh!

starocean999 commented Feb 11, 2025

Uh oh!

qzsee commented Feb 12, 2025

Uh oh!

dqz123 commented Feb 14, 2025

Uh oh!

github-actions bot commented Feb 14, 2025

Uh oh!

github-actions bot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

dqz123 commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

dqz123 commented Feb 19, 2025

Uh oh!

doris-robot commented Feb 19, 2025

Uh oh!

doris-robot commented Feb 19, 2025

Uh oh!

doris-robot commented Feb 19, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

qzsee commented Feb 7, 2025 •

edited

Loading